Brzozowski derivative

Short description: Function defined on formal languages in computer science

Brzozowski derivative (on red background) of a dictionary string set with respect to the string "con"

In theoretical computer science, in particular in formal language theory, the Brzozowski derivative [math]\displaystyle{ u^{-1}S }[/math] of a set [math]\displaystyle{ S }[/math] of strings and a string [math]\displaystyle{ u }[/math] is the set of all strings obtainable from a string in [math]\displaystyle{ S }[/math] by cutting off the prefix [math]\displaystyle{ u }[/math]. Formally:

[math]\displaystyle{ u^{-1}S = \{v \in \Sigma^* \mid uv \in S\} }[/math].

For example,

[math]\displaystyle{ c^{-1}\{\text{cat}, \text{cow}, \text{dog}\} = \{\text{at}, \text{ow}\}. }[/math]

The Brzozowski derivative was introduced under various different names since the late 1950s. Today it is named after the computer scientist Janusz Brzozowski who investigated its properties and gave an algorithm to compute the derivative of a generalized regular expression.

Definition

Even though originally studied for regular expressions, the definition applies to arbitrary formal languages. Given any formal language [math]\displaystyle{ S }[/math] over an alphabet [math]\displaystyle{ \Sigma }[/math] and any string [math]\displaystyle{ u \in \Sigma^* }[/math], the derivative of [math]\displaystyle{ S }[/math] with respect to [math]\displaystyle{ u }[/math] is defined as:

[math]\displaystyle{ u^{-1}S = \{v \in \Sigma^* \mid uv \in S\} }[/math]

The Brzozowski derivative is a special case of left quotient by a singleton set containing only [math]\displaystyle{ u }[/math]: [math]\displaystyle{ \ u^{-1}S = \{u\} \;\backslash\; S }[/math].

Equivalently, for all [math]\displaystyle{ u,v \in \Sigma^* }[/math]:

[math]\displaystyle{ v \in u^{-1}S \;\Leftrightarrow\; uv \in S. }[/math]

From the definition, for all [math]\displaystyle{ u, v \in \Sigma^* }[/math]:

[math]\displaystyle{ (uv)^{-1}S = v^{-1}(u^{-1}S) }[/math]

since for all [math]\displaystyle{ w \in \Sigma^* }[/math], we have [math]\displaystyle{ w \in (uv)^{-1}S \Leftrightarrow uvw \in S \Leftrightarrow vw \in u^{-1}S \Leftrightarrow w \in v^{-1}(u^{-1}S) }[/math].

The derivative with respect to an arbitrary string reduces to successive derivatives over the symbols of that string, since for all [math]\displaystyle{ a \in \Sigma, u \in \Sigma^* }[/math]: [math]\displaystyle{ \begin{align} (ua)^{-1}S &= a^{-1}(u^{-1}S) \\ \varepsilon^{-1}S &= S \end{align} }[/math]

A language [math]\displaystyle{ S \subseteq \Sigma^* }[/math] is called nullable if and only if it contains the empty string [math]\displaystyle{ \varepsilon }[/math]. Each language [math]\displaystyle{ S }[/math] is uniquely determined by nullability of its derivatives:

[math]\displaystyle{ w \in S \ \Leftrightarrow\ \varepsilon \in w^{-1}S }[/math]

A language can be viewed as a (potentially infinite) boolean-labelled tree (see also tree (set theory) and infinite-tree automaton). Each possible string [math]\displaystyle{ w \in \Sigma^* }[/math] denotes a node in the tree, with label true when [math]\displaystyle{ w \in S }[/math] and false otherwise. In this interpretation, the derivative with respect to a symbol [math]\displaystyle{ a }[/math] corresponds to the subtree obtained by following the edge [math]\displaystyle{ a }[/math] from the root. Decomposing a tree into the root and the subtrees [math]\displaystyle{ a^{-1}S }[/math] corresponds to the following equality, which holds for every language [math]\displaystyle{ S \subseteq \Sigma^* }[/math]:

[math]\displaystyle{ S = (\{\varepsilon\} \cap S) \cup \bigcup_{a \in \Sigma} a(a^{-1}S). }[/math]

Derivatives of generalized regular expressions

When a language is given by a regular expression, the concept of derivatives leads to an algorithm for deciding whether a given word belongs to the regular expression.

Given a finite alphabet A of symbols, a generalized regular expression R denotes a possibly infinite set of finite-length strings over the alphabet A, called the language of R, denoted L(R).

A generalized regular expression can be one of the following (where a is a symbol of the alphabet A, and R and S are generalized regular expressions):

• "∅" denotes the empty set: L(∅) = {},
• "ε" denotes the singleton set containing the empty string: L(ε) = {ε},
• "a" denotes the singleton set containing the single-symbol string a: L(a) = {a},
• "R∨S" denotes the union of R and S: L(R∨S) = L(R) ∪ L(S),
• "R∧S" denotes the intersection of R and S: L(R∧S) = L(R) ∩ L(S),
• "¬R" denotes the complement of R (with respect to A*, the set of all strings over A): L(¬R) = A* \ L(R),
• "RS" denotes the concatenation of R and S: L(RS) = L(R) · L(S),
• "R*" denotes the Kleene closure of R: L(R*) = L(R)*.

In an ordinary regular expression, neither ∧ nor ¬ is allowed.

Computation

For any given generalized regular expression R and any string u, the derivative u⁻¹R is again a generalized regular expression (denoting the language u⁻¹L(R)). It may be computed recursively as follows.

(ua)−1R	= a−1(u−1R)	for a symbol a and a string u
ε−1R	= R

Using the previous two rules, the derivative with respect to an arbitrary string is explained by the derivative with respect to a single-symbol string a. The latter can be computed as follows:

a−1a	= ε
a−1b	= ∅	for each symbol b≠a
a−1ε	= ∅
a−1∅	= ∅
a−1(R*)	= (a−1R)R*
a−1(RS)	= (a−1R)S ∨ ν(R)a−1S
a−1(R∧S)	= (a−1R) ∧ (a−1S)
a−1(R∨S)	= (a−1R) ∨ (a−1S)
a−1(¬R)	= ¬(a−1R)

Here, ν(R) is an auxiliary function yielding a generalized regular expression that evaluates to the empty string ε if R 's language contains ε, and otherwise evaluates to ∅. This function can be computed by the following rules:

ν(a)	= ∅	for any symbol a
ν(ε)	= ε
ν(∅)	= ∅
ν(R*)	= ε
ν(RS)	= ν(R) ∧ ν(S)
ν(R ∧ S)	= ν(R) ∧ ν(S)
ν(R ∨ S)	= ν(R) ∨ ν(S)
ν(¬R)	= ε	if ν(R) = ∅
ν(¬R)	= ∅	if ν(R) = ε

Properties

A string u is a member of the string set denoted by a generalized regular expression R if and only if ε is a member of the string set denoted by the derivative u⁻¹R.

Considering all the derivatives of a fixed generalized regular expression R results in only finitely many different languages. If their number is denoted by d_R, all these languages can be obtained as derivatives of R with respect to strings of length less than d_R. Furthermore, there is a complete deterministic finite automaton with d_R states that recognises the regular language given by R, as stated by the Myhill–Nerode theorem.

Derivatives of context-free languages

Derivatives are also effectively computable for recursively defined equations with regular expression operators, which are equivalent to context-free grammars. This insight was used to derive parsing algorithms for context-free languages. Implementation of such algorithms have shown to have cubic time complexity, corresponding to the complexity of the Earley parser on general context-free grammars.

See also

• Quotient of a formal language